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In  the  first  step  of  the  project  we  had  to  verify  the  suggested  algorithm,  (Throughput  Analysis  of 
Blocking  Networks),  described  in  the  proposal  on  pages  7,  8  and  0,  to  be  accurate.  We  studied 
several  teat  examples  and  compared  our  results  with  simulaqtion  obtained  by  IBM-REISQ  simular 
tion  package.  The  study  showed  that  the  algorithm  b  very  accurate.  The  results  obtained  showed 
deviations  from  the  simulation  counterparts  on  the  average  4%  The  paper,  [ij,  where  thb  algo¬ 
rithm  u  described  in  detail  has  been  accepted  by  IEEE  TrantacHotu  on  Computers”  in  October 
1987.  The  paper  will  appear  in  November  1988  or  March  1989  issue. 

While  we  were  working  on  the  validation  of  the  throughput  algorithm  mentioned  above,  we 
developed  another  new  throughput  algorithm  for  blocking  queueing  networks  having  stations  with 
general  service  time  distributions  and  FCFS  scheduling  disciplines.  The  research  results  obtained 
in  this  part  are  so  significant  that  the  paper,  [2],  was  accepted  into  "Performance  87”  Conference 
where  the  acceptance  rate  was  only  25%.  We  attended  the  conference  in  Brusseb/Belgium  in 
December  1987  and  presented  the  paper. 

The  problem  of  determining  the  capacity  of  the  composite  station,  section  3.2.  of  the  proposal, 
has  abo  been  attacked  and  solved  partially.  Some  ideas  have  been  described  in  [3j  where  a  com¬ 
puter  network  with  local  and  global  window  flow  control  is  analyzed.  We  suggest  som^’.  formulas 
for  the  computation  of  the  capacity  of  the  composite  (flow-equivalent)  station.  However,  we  real¬ 
ized  that  the  formulas  do  not  perform  very  accurate  for  all  cases.  There  b  still  some  need  for 
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investigation  of  this  part.  The  paper  (3j  was  accepted  to  the  INFOCOM  88  Conference.  We 
attended  the  conference  in  New  Orleans  in  March  1988  and  presented  the  paper. 

There  is  another  type  of  blocking  which  is  known  as  "Rejection  Blocking  in  the  literature.  In  this 
case  the  blocking  occurs  when  a  job  completing  service  at  station  i  attempts  to  join  destination  staUon 
j.  If  station  j  is  full  at  that  moment,  the  job  is  rejected.  The  rejected  job  goes  back  to  the  server  of  the 
station  i  and  receives  another  round  of  service.  This  is  repeated  until  some  job  completes  a  service  at 
station  j  and  a  place  becomes  available.  This  blocking  type  has  been  used  to  model  systems  such  as 
production  systems  and  telecommunication  systems.  In  particular,  in  token  ring  networks,  the  station 
which  has  the  token,  may  transmit.  In  case  of  nonsuccessful  transmission  the  token  comes  back  to  the 
station  which  retries  the  transmission. 

Within  this  project  we  also  attacked  queueing  networks  with  this  type  of  blocking  and  obtained  the 
results  described  below: 

1.  In  (4]  we  obtained  an  exact  product  form  solution  for  equilibrium  state  probabilities  for  single 
class  closed  rejection  blocking  networks  which  have  reversible  routing.  An  algorithm  is  given  for 
computation  of  performance  measures.  For  nonreversible  networks  we  found  out  that  the  state 
space  of  a  blocking  queueing  network  is  isomorphic  to  the  state  space  of  a  nonblocking  network 
under  a  particular  condition.  This  paper  was  accepted  into  the  GI/NTG  Conference.  We  attended 
the  conference  in  Erlangen/West  Germany  in  September  1987  and  presented  the  paper. 

2.  In  [5]  we  investigated  open,  mixed  and  closed  queueing  networks  with  multiple  job  classes,  rever¬ 
sible  routing  and  rejection  blocking.  Jobs  could  change  class  membership  and  load  dependent 
general  service  time  distributions  were  allowed.  We  prove  that  the  equilibrium  state  probabilities 
have  product  form.  The  solution  implies  insensitivity  in  this  kind  of  blocking  networks,  i.  e.  the 
distribution  of  the  jobs  in  equilibrium,  irrespective  of  their  remaining  service  times.  This  work  is 
also  presented  at  the  Conference  ’’Analysis  and  Control  of  Large  Scale  Stochastic  Systems”,  Chapel 
Hill,  NC,  May  23-25,  1988. 
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2.  In  [6]  we  studied  the  same  model  as  in  [5].  Using  the  product  form  of  the  equilibrium  state  dis¬ 
tribution  obtained  in  [5],  we  derive  exact  algorithms  to  compute  performance  measures,  such  as 
mean  number  of  jobs  and  throughputs. 

3.  State-dependent  routing  is  a  very  important  issue  in  computer  systems  and  communication  net¬ 
works.  For  particular  infinite  capacity  networks  there  exist  solutions  in  the  literature.  However, 
considering  the  state  dependent  routing  with  the  blocking  phenomenon  in  queueing  network 
models,  makes  the  analysis  more  complex.  In  [7]  we  attacked  this  problem  and  solved  it  for  cen¬ 
tral  server  models  with  multiple  job  classes.  Using  the  concept  of  job  local  balance,  we  prove  that 
the  equilibrium  state  probabilities  of  these  networks  take  a  modified  product  form  solution.  We 
also  develop  an  algorithm  for  the  computation  of  performance  measures,  like  throughputs  and  the 
mean  number  of  jobs,  is  given. 
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Queueing  networks  have  a  great  popularity  as  models  of  computer  systems  since  the  early  seventies,  because 
they  allow  the  modeling  of  multiple  independent  resources  such  as  CPU’s  and  I/O  devices  and  the  sequential  use  of 
these  resources  by  different  jobs.  The  basic  results  of  queueing  network  theory  were  given  by  Jackson, 
Gordon/Newell  [JACK63,  GORD67a]  where  they  showed  that  the  solution  of  open  and  closed  queueing  networks 
with  single  job  class,  exponentially  distributed  arrival  and  service  times,  First-Come-First-Served  queueing  discip¬ 
lines  at  ail  stations  have  a  product  form.  This  product  f(Mm  implies  that  the  equilibrium  state  probabilities  consist 
of  facton  r^resenting  the  states  of  the  individual  stations.  As  a  result  the  individual  stations  behave  as  if  they  were 
separate  queueing  systems.  Baskett,  Chandy,  Muntz  and  Palacios  [BCMP75]  extended  the  results  of  [JACK63, 
GORD67a]  to  obtain  product  form  soludons  for  open,  closed  and  mixed  queueing  networks  with  different  job 
classes,  nonexponential  service  dme  distributions  and  diffoent  queueing  disciplines  such  as  First-Come-First- 
Served  (FCFS),  Processor  Sharing  (PS),  Last  Come  First  Served  Preemptive  Resume  (LCFS-PR). 


Product  form  queueing  networks  (also  known  as  BCMP  or  separable  networks)  have  proved  invaluable  in 
modeling  a  variety  of  computer  and  communicadon  systems.  They  are  flexible  enough  to  represent  adequately  many 
of  the  features  arising  in  such  applicaUons.  They  have  not,  however,  been  able  to  provide  much  insight  into  the 
phenomenon  of  blocking,  because  all  algorithms  for  product  form  networks  are  based  on  the  assumpdon  that  the 
stadons  have  infinite  capacities.  If  the  stations  have  finite  capacities,  blocking  can  occur  in  the  network. 


Various  types  of  blocking  have  been  considered  in  the  literature  so  far.  These  blocking  types  arose  out  of 
various  studies  of  real  life  systems.  We  classify  the  blocking*networks  as  "Classical  Blocking"  and  "Rejection 
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Blocking"  networks.  In  the  first  case,  classical  blocking,  blocking  occurs  when  a  job  completing  service  at  station  i 
cannot  proceed  to  station  j  because  station  j  is  full.  The  job  is  forced  to  wait  in  station  t’s  server  until  it  is  allowed  to 
enter  the  destinadon  stadon  j.  Station  i's  server  stops  processing  until  stadon  j  releases  a  job.  This  blocking  type  has 
been  used  to  model  systems  such  as  production  systems  and  disk  I/O  subsystems.  In  the  second  case,  rejection 
blocking,  blocking  occurs  when  a  job  completing  service  at  station  i  attempts  to  join  destination  station  j.  If  station  j 
is  full  at  that  moment,  the  job  is  refused.  The  rejected  job  goes  with  a  certain  probability  (which  we  will  call  the 
rejection  probability)  back  to  station  <’s  server  and  receives  a  new  service.  This  is  repeated  until  some  job  completes 
a  service  at  station;  and  a  place  becomes  available.  This  blocking  type  has  been  used  to  model  systems  such  as  pro¬ 
duction  systems  and  telecommunication  systems. 

In  recent  years  there  has  been  a  growing  interest  in  the  development  of  computational  methods  to  analyze 
queueing  networks  with  blocking.  The  interest  developed  primarily  from  the  realization  that  these  models  are  useful 
in  the  study  of  system  behavior  of  computers  and  communication  networks,  in  addition  to  providing  detailed 
descriptions  of  several  computer-related  applications. 

Most  of  the  previous  woik  is  based  on  investigating  "Rejectioa  Blocking”  in  both  open  queueing  networks 
[KONH76,77]  and  closed  queueing  networks  (BALS83,  GORD67b,  HORD81,  PnT79,  SURI84].  Konheim/Reiser 
(KONH76.77]  propose  an  algorithm  for  the  solution  of  an  open  system  consisting  of  two  single  server  stations  with 
exponential  service  time  distributions.  It  also  permits  a  feedback  from  the  second  station  to  the  first  station’s  queue. 
Pittel  (Pn  179],  Hordijk/Van  Dijk  [HORD81}  and  Balsamo/Iazeoalla  [BALS83]  have  shown  that  the  equilibrium 
state  probability  distribution  has  a  product  form,  given  that  the  ’’reversibility"  condition  holds  in  closed  queueing 
networks  with  rejection  blocking. 

The  Suri/Diehl  [SURI84]  study  examined  closed  tandem  queueing  networks  with  finite  station  capacities  in 
which  the  first  queue  has  a  capacity  larger  than  the  number  of  jobs  in  the  system.  By  application  of  Norton’s 
Theorem  [CHAN75],  they  reduce  (N-1)  stations  to  a  single  station  with  a  variable  size  queue  capacity  and  obtain  a 
two-station  network  that  is  easy  to  analyze.  An  approximation  algorithm  is  derived  for  the  mean  sojourn  time  of  a 
job,  assuming  exponentially  distributed  service  times.  The  main  disadvanuges  to  this  technique  were  that  validation 
tests  were  restricted  to  networks  with  very  small  populations  and  their  algorithm  is  restricted  only  to  serially 
switched  stations. 
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"Classical  Blocking"  networks  have  also  been  investigated  extensively  in  recent  years  [AKYL8Sa,b,c,d, 
PERR81,  PERR86,  TAKA80].  In  [AKYLSSa]  we  studied  two-station  closed  queueing  networks  with  classical 
blocking  and  nmltiple  server  stations.  We  have  shown  that  the  equilibrium  state  probability  distributions  of  such 
blocking  systems  are  identical  to  those  of  a  two-station  closed  queueing  network  without  blocking.  In  [AKYLSSb] 
we  show  that  the  throughput  of  a  blocking  network  with  K  total  number  of  jobs  is  approximately  equal  to  the 
throughput  of  a  nonblocking  network  with  an  appropriate  total  number  of  jobs  which  can  be  easily  calculated.  In 
[AKYLSSc]  we  introduce  an  approximation  algorithm  for  obtaining  the  throughput  and  mean  queue  length  of  closed 
exponential  queueing  networks  with  blocking.  In  [AKYLSSd]  we  extend  the  well-known  mean  value  analysis  algo¬ 
rithm  [REIS80]  to  single  server  queueing  networks  with  blocking.  The  approximation  is  based  on  the  modification 
of  mean  residence  times  due  to  the  blocking  events  that  occur  in  the  network. 

Takahashi.  Miyahara  and  Hasegawa  [TAKA80]  developed  a  method  for  approximate  analysis  of  open  queue¬ 
ing  networks  with  classical  blocking.  Each  station  is  treated  as  an  M/M/1  finite  capacity  queueing  system  whose 
arrival  rate  and  mean  service  time  are  expressed  in  terms  of  the  blocking  probabilities.  These  probabilities  are  in 
turn  expressed  in  terms  of  the  arrival  rates  and  mean  service  times  yielding  a  set  of  N  simultaneous  non-linear  equa¬ 
tions  whose  solution  yields  an  approximation  for  blocking  probabilities.  Approximations  for  other  performance 
measures  can  be  obtained  from  these  probabilities.  However,  only  a  very  limited  accuracy  assessment  was  per¬ 
formed. 

Perros  [PERR81]  considered  a  general  class  of  open  exponential  queue  networks  consisting  of  n  (n>2) 
queues  in  parallel  being  serviced  by  servers  who  form  a  hierarchical  structure.  Blocking  of  a  server  occurs  each 
time  the  server  completes  a  service.  The  server  remains  blocked  until  its  blocking  unit  departs  from  the  network 
having  received  service  by  all  the  other  servers  to  which  this  server  is  linked.  Approximate  and  exact  results  for  the 
utilization  of  a  station  were  obtained.  Perros/ Altiok  [PERR861  analyze  open  queueing  networks  with  exponentially 
distributed  service  times.  Their  work  is  based  on  communication  networks  in  which  each  station  is  serially  switched. 
A  Cox  distribution  for  each  station  is  developed  in  which  the  second  phase  represents  the  blocking  phase  of  tlie 
corresponding  station.  Blocking  probabilities  are  determined  using  an  iterative  formula. 

Several  other  investigators  in  recent  years  have  published  results  on  queueing  networks  with  rejection  as  well 
as  classical  blocking.  An  excellent  bibliography  concerning  qj^gueing  network  models  with  blocking  is  given  by 


-4. 


Perros  [rcRR84].  Our  literature  review  suggests  that  existing  or  proposed  methods  either  contain  disadvantages 
(e.g.,  long  run  times  and/or  memory  space)  and/or  restrictions  (only  two-station  or  tandem  network  solutions)  or 
provide  approximate  results  which  differ  widely  from  the  exact  values.  The  blocking  network  models  which  have 
been  investigated  so  far  have  the  following  additional  limitations: 

i)  All  service  time  distributions  are  exponential. 

ii)  The  queueing  discipline  at  each  station  is  basically  FC!FS. 

iii)  All  stations  may  have  single  (load  independent)  servers. 

In  this  proposal  we  will  attack  these  limitations  and  propose  new  solutions  for  closed  queueing  networks  with 
blocking. 

2.  Model  Assumptions 

We  consider  closed  queueing  networks  with  N  stations  and  K  total  jobs.  Each  station  in  the  network  may 
have  the  following  four  sution  types: 

•  Type  la.  ( W  /M  / 1  -FCFS  ] 

•Type  lb.  [  Af  /  W  /  W  -  FCFS  ]  (Id:  load-dependent  server;  allows  multiple  servers) 

•  Type2.[e/G  /l-PS] 

•  Type3.  [v/C  //S  -  .  ] 

•  Type  4.  [  •/  C  / LCFS~PR  ] 

Each  station  of  Type  la  or  Type  lb  has  exponential  service  time  distribution  and  of  Type  2,3,4  general  ser¬ 
vice  dme  distribution  with  mean  values  1/(1^  for  i  =  1,...JV.  The  service  rate  of  Type  lb  station  is  load  dependent 
M,  (*).  Note  that  four  types  of  stations  are  motivated  by  some  practical  considerations.  Type  1  stations  are  useful  in 
many  instances  (secondary  memory  units,  input-output  devices,  etc.).  Type  2  stations  are,  in  many  cases,  a  reason¬ 
able  representation  of  the  CPU  allocated  in  quanta;  the  processor  sharing  discipline  is  an  idealization  with  a  quan¬ 
tum  of  "infinitesimally  small"  (in  fact,  zero)  duration  and  no  overhead  associated  with  switching  from  one  job  to  the 
other.  A  Type  3  stadon  represents  well  terminals  in  a  time-sharing  system.  Type  4  stations  can  be  used  to  represent 
stacks  in  dau  structure  models. 
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Each  sudon  also  has  a  fixed  finite  capacity  Af.  where  A/j  =  (queue  capacity  +  1),  ( for  i  =  1,2,...^  ).  Cases 
in  which  the  stations  can  have  infinite  capacity  are  also  allowed.  (A/,  =  «  ),  (for  some  i  =  1 , 2 , Af ).  Any  sta¬ 
tion  whose  capacity  exceeds  the  total  number  of  jobs  in  the  network  can  be  considered  to  have  infinite  capacity.  A 
job  which  is  serviced  by  the  i-th  station  proceeds  to  the  y-th  station  with  probability  ,  (for  i  ,j  =  l  ,2,  ■  ■■  ,N), 
if  the  y-th  station  is  not  full.  That  is,  if  the  number  of  jobs  in  the  y-th  station,  kj,  is  less  or  equal  lo  Mj  for 
y=l,2,...JV.  Otherwise,  the  job  is  blocked  in  the  r-th  station  until  a  job  in  the  y-th  station  has  completed  its  servicing 
and  a  place  becomes  available. 

Furthermore,  we  assume  that 

K<^Mi  (1) 

which  implies  that  the  total  number  of  jobs  AT  in  the  network  may  not  exceed  the  total  station  capacity  of  the  entire 
network. 

One  of  the  most  important  problems  to  realize  regarding  blocking  queueing  networks  is  that  finite  station 
capacities  and  blocking  can  introduce  the  problem  of  system  deadlock.  Deadlock  may  occur  if  a  job  which  has 
finished  its  service  at  station  < 's  server  wants  join  station  y ,  whose  capxity  is  full.  That  job  is  blocked  in  station  i . 
Another  job  which  has  finished  its  serv  ice  at  y  -th  station  now  wants  to  proceed  to  the  i  -th  station,  whose  capacity  is 
also  fuU.  It  blocks  station  y.  Both  jobs  are  waiu,''g  for  each  other.  As  a  result  a  deadlock  situation  arises.  In 
[AKYL86a]  we  have  demonstrated  the  necessary  conditions  for  a  closed  queueing  network  with  single  job  class  to 
be  deadlock  free.  The  following  assumption  states  that  a  closed  queueing  nehvork  containing  finite  station  capaci¬ 
ties  is  deadlock  free  if  and  only  if  for  each  cycle  C  in  the  network  the  following  condition  holds: 

Af  <  Z  Af,  (2) 

Simply  stated,  the  total  number  jobs  in  the  network  must  be  smaller  than  the  sum  of  station  capacities  in  each  cycle. 
Since  tandem  queueing  networks  have  only  one  cycle,  this  condition,  equation  (2),  corresponds  to  equation  (1). 
Equation  (1)  is  a  sufficient  condition  for  tandem  networks  to  be  deadlock  free. 

With  these  assumptions  we  obtain  the  queueing  network  model,  classified  as  classical  blocking  which  will  be 


the  object  of  our  investigation. 


3.  Norton’s  Theorem  Application  on  Blocking  Queueing  Networks  (PROPOSED  CONCEPT  I) 


The  parametric  analysis  is  based  on  an  application  of  Norton’s  Theorem  from  electrical  circuit  theory  to 
queueing  networks.  Chandy,  Herzog  and  Woo  [CHAN75]  showed  that  Norton’s  Theorem  provides  an  exact 
analysis  of  queueing  networks,  if  such  networks  have  a  product  form  solution.  We  explain  this  concept  by  consid¬ 
ering  a  closed  queueing  network  model  with  K  jobs  andN  =  12  stations  shown  in  Figure  1. 


Figure  1. 

With  this  queueing  network  model  we  can  construct  an  equivalent  network  in  which  we  arbitrarily  select  a 
station  N,  and  replace  the  other  (N  -  1)  stations  by  a  single  station,  called  the  composite  (flow-equivalent)  station 
as  shown  in  Figure  2. 


nnh® — <iiii 


"composite  station' 


Figure  2. 

Let  Pc  (k)  be  the  composite  mean  service  rate,  where  k  is  the  number  of  Jobs  at  this  composite  station.  These 
composite  mean  service  rates  Pe(k),  (ior  k=\,...J(),  are  determined  by  analyzing  a  modifled  version  of  the  given 
network,  in  which  the  selected  station  N  has  been  shorted  as  shown  in  Figure  3. 


Figure  3. 

The  mean  service  time  of  that  sution  1/^  is  set  equal  to  zero  and  the  throughputs  Mk).  of  the  shorted  system 
for  all  jobs  are  calculated.  These  computed  throughputs  through  the  shorted  network  X(lc),  are  set 

equal  to  the  coirqKMite  mean  service  rates  {k ).  The  solutions  of  the  network  consisting  of  the  selected  and  com¬ 
posite  stations  are  identical  to  those  of  the  originally  given  network  model. 

The  parametric  analysis  of  Qtandy,  Herzog  and  Woo  tCHAN75]  is  very  interesting  for  cases  in  which  only 
one  station  (e.g.,  a  CPU)  in  a  queueing  network  model  is  to  be  analyzed  under  various  system  workload. 

The  parametric  analysis  of  blocking  queueing  networks  is  executed  as  follows: 

3.1.  Computation  of  the  Throughput  Values  of  the  Subsystem 

3.2.  Determining  of  the  Composite  Station  Capacity 

3.3.  Analysis  of  the  Two-Stadon  Load  Dependent  Network 

3.1.  Throughput  Analysis  of  Blocking  Networks 

We  already  have  an  algorithm  to  calculate  the  throughput  of  a  blocking  network  with  single  server  stations 
[AKYL85b,c].  Here  we  propose  an  extension  of  that  algorithm  for  blocking  networks  with  different  sution  types. 

The  basic  concept  is  that  the  sute  space  of  the  blocking  queueing  network  with  K  total  number  of  Jobs  is 
transformed  into  the  sute  space  of  a  nonblocking  queueing  network  with  K  total  number  of  jobs.  The  number  of 
states  in  both  networks  should  be  approximately  the  same,  if  not  identical.  This  would  indicate  that  Markov 
processes  describing  the  evolution  of  both  networks  over  time  have  an  almost  identical  structure.  That,  in  turn, 
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would  guarantee  that  the  throughputs  of  both  systems  are  almost  equal. 

The  following  steps  are  executed  in  order  to  compute  the  throughput  values  in  queueing  networks  with  block¬ 
ing. 

3.1.1.  Determine  the  number  of  sutes  in  blocking  queueing  network. 

3.1.2.  Determine  the  total  number  of  jobs  K  in  the  equivalent  nonblocking  queueing  network. 

3.1.3.  Analyze  the  nonblocking  queueing  network  with  K  jobs  to  obtain  the  throughput  values  which  are 
equal  to  the  throughput  value  of  the  blocking  network  with  K  jobs. 

3.1.1,  Determine  the  number  of  states  in  blocking  queueing  networks 

As  previously  mentioned,  in  blocking  networks  each  station  has  a  capacity  limit,  which  indicates  that  only  a 
certain  number  of  states  can  be  feasible.  The  feasible  states  for  blocking  networks  are  obtained  by  realizing  that  the 
number  of  jobs  in  the  x'-th  station  k,  may  not  exceed  its  capacity  ,  k,-  S  Af, . 

Blocking  events  which  occur  in  networks  with  finite  sution  capacities  must  also  be  taken  into  account.  There¬ 
fore,  the  m^  (number  of  servers)  neighbors  of  the  feasible  states  are  included,  representing  the  blocking  states. 
Whenever  a  transition  occurs  from  one  state  to  another  sute  in  which  the  capacity  limit  of  a  station  would  be 
violated,  we  assume  that  the  transition  causes  a  blocking  action  in  the  network  and  that  the  state  entered  is  a  block¬ 
ing  state.  In  reality,  the  job  still  resides  in  the  source  station.  All  the  other  states  are  infeasible  and  are  cancelled. 

Using  this  method  we  obtain  a  sub-state  space  for  the  blocking  network.  From  the  reduced  state  space  we  can 
obtain  the  number  of  states  Z'  of  the  blocking  network,  which  is  the  sum  of  feasible  states  and  blocking  sutes. 
Since  the  number  of  sutes  Z  can  be  very  large  for  general  networks  we  cannot  draw  the  sute  space,  eliminate  the 
nonfeasible  sutes  or  count  the  total  number  of  feasible  sutes  and  their  neighbors  as  blocking  states  in  an  efficient 
way.  In  order  to  directly  obtain  the  number  of  states  Z'  in  queueing  networks  with  blocking,  we  have  developed  an 
efficient  convolution  algorithm  [AKYL8Sb,c]  which  is  applicable  only  to  networks  conuining  Type  la  sutions.  We 
must  find  an  efficient  algorithm  which  provides  the  number  of  sutes  Z'  (the  feasible  states  and  their  neighbors  as 
blocking  sutes)  in  closed  queueing  networks  with  four  different  finite  capacity  sution  types. 
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3.1.2.  Determine  the  total  number  of  Jobs  in  the  equivalent  nonblocking  network 

Our  primaiy  objective  is  to  Gnd  an  equivalent  nonblocking  network  which  has  the  same  number  of  states  and 
the  same  state  space  structure  as  the  blocking  network.  In  general,  the  sute  space  of  the  blocking  network  cannot  be 
transformed  bijectively  into  the  state  space  of  an  equivalent  nonblocking  network.  However,  the  number  of  states  in 
both  systems  may  be  equal  or  almost  equivalent.  This  would  imply  that  both  systems  have  the  same  behavior  and 
the  throughputs  of  both  systems  are  almost  identical.  Assume  that  the  number  of  states  Z'  (feasible  and  blocking 
states)  in  the  blocking  queueing  network  is  obtained  somehow.  The  goal  is  to  find  a  total  number  of  jobs  K  in  an 
equivalent  network  with  infinite  station  capacities  which  will  provide  almost  the  same  number  of  states,  Z,  as  in  the 
blocking  network.  We  then  find  an  appropriate  total  number  of  jobs  K  in  the  equivalent  nonblocking  network  such 
that  Z  will  be  approximately  equal  to  2f . 

Since  the  number  of  states  in  both  systems  will  be  equal  or  almost  equal,  it  implies  that  the  Markov  processes 
describing  the  evolution  of  both  networks  have  approximately  the  same  behavior.  Consequently,  the  throughput  of 
the  equivalent  nonblocking  network  almost  equivalent  to  the  throughput  of  the  blocking  network  Xg  (AT). 

3.1.3.  Determine  the  throughput  of  the  equivalent  nonblocking  network 

By  analyzing  the  equivalent  nonblocking  network  with  K  total  jobs  using  a  product  form  algorithm  such  as 
mean  value  analysis,  [RE1S80],  we  obtain  the  total  throughput  Xf/gik)-  This  is  almost  identical  to  the  total 
throughput  Xg  (K)  of  the  blocking  network  with  K  total  number  of  jobs  [AKYL85b]. 

W)  =  (3) 

Note  that  we  do  not  need  any  other  performance  measures  than  the  throughput  of  the  subsystem.  By  varying  the 

number  of  jobs  in  the  subsystem,  from  I  to  AT,  we  can  obtain  Xg(l),Xg(2) ,  •  •  •  ,  Xg(K).  Note  that  the  throughput 
values  Xjlk)  for  k  =  for  the  blocking  network  are  approximate.  Consequently  the  parametric  analysis  for 
blocking  networks  will  provide  approximate  results. 

3.2.  Oetermiaing  the  Capacity  of  the  Composite  Station 

The  given  system  has  been  reduced  to  a  two-station  blocking  network.  The  service  rate  of  composite  station 
lie(k)  is  load-dependent,  and  set  equal  to  the  computed  throughputs  Xa(k)  for  k  =  1,...,AC.  The  major  problem 
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which  arises  is  the  capacity  of  the  con^site  station.  Inidalty,  we  define  the  capacity  of  the  composite  station  as: 

Af,  =  £  Mi  (4) 

i  e  « 

where  a  represents  the  subsystem. 

Our  experience  shows  that  this  overestimates  throughput,  since  the  shorted  station  can  be  blocked  in  the 
actual  network  with  less  than  M j  jobs  in  the  subsystem  a. 

Another  possibility  is  using  a  capacity  weighted  by  the  transition  probabilities  from  the  shorted  station  i  to  the 
stations  in  the  subsystem: 

A'.  =  Z  Pa  (5) 

J  tc 

However,  we  have  discovered  that  this  underestimates  the  throughput. 

Note  that  Suri/Diehl  [SURI86]  realized  also  this  fact  and  solved  this  problem  by  constructing  so-called 
"views"  as  seen  by  the  previous  station.  They  assume  that  the  shorted  station  i  must  have  infinite  capacity.  The 
"view"  seen  by  station  i  is  for  k  jobs  in  the  successor  stations  sometimes  sees  the  station  i  as  blocked  and  some¬ 
times  unblocked.  Thus,  the  shotted  station  i  sees  a  finite  buffer  of  variable  size  1;  in  the  composite  station.  They 

s 

introduce  a  so-called  variable  buffer  size  model  which  represents  the  view  seen  by  the  shorted  station  i .  An  iterative 
formula  is  used  to  compute  the  views.  There  are  some  limitations  in  their  work.  The  model  is  restricted  to  single 
server  tandem  networits,  in  particular,  the  job  flow  can  only  be  in  one  direction.  The  network  cannot  have  arbitrarily 
switched  stations.  Another  limitation  is  that  the  shorted  station  must  have  an  infinite  capacity.  Their  work  will 
definitely  help  us  in  our  investigations. 

3  J.  Analysis  of  the  Two-Station  Load  Dependent  Network 

In  [AKYL85a]  we  have  shown  that  two-station  closed  queueing  networks  with  blocking  have  an  exact  pro¬ 
duct  form  solution.  The  solution  concept  is  based  on  the  transfomution  of  the  state  space  of  the  blocking  queueing 
network  into  a  state  space  for  a  nonblocking  network.  The  state  space  of  two-station  queueing  networks  is  one¬ 
dimensional.  It  is  easy  to  find  an  equivalent  nonblocking  network  which  has  exactly  the  same  structure  as  the  block¬ 
ing  network.  In  [AKYL8Sa,b]  we  have  proved  the  following  theorem: 

Theorem.  For  a  two-station  closed  queueing  network  with  classical  blocking  there  exists  an  equivalent  two-station 
closed  queueing  network  without  blocking  having  the  same  stfScture.  The  equilibrium  state  probabilities  p(k ,,  kj) 
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for  the  blocking  network  are  confuted  by  the  product  form  solution  for  the  equivalent  nonblocking  network. 

In  the  load-dependent  case  the  following  problem  can  cause  the  results  for  two-station  network  to  be  only 
approximate.  State  transitions  of  the  blocking  and  equivalent  nonblocking  network  do  not  agree.  This  will  be 
explained  by  a  numerical  example.  Assume  a  two-stadon  network  with  K  =  6  jobs  are  given.  The  first  station  has 
the  capacity  Af  | »  4  and  the  second  sution  Af  2  =  3.  The  service  rate  of  the  first  station  is  load-independent  Hj  where 
the  second  station  has  load-dependent  service  rates  The  state  space  diagram  for  the  above  network  is; 


Figure  4. 

By  considering  the  station  capacities  the  following  sub-state  space  is  obtained  shown,  in  Figure  S,  containing  the 
feasible  states  and  the  blocking  states  (denoted  by  * )  for  the  blocking  network. 


Figure  S. 

Now  we  find  a  nonblocking  network  with  an  appropriate  number  of  jobs  K  which  provides  the  same  state 
space  structure  as  the  blocking  network.  Since  tiiere  are  Z'  =  4  states  in  Figure  5,  we  find  that  K  -Z.  The  state 
space  for  K  =  3  jobs  is  shown  in  Figure  6. 


Figure  6. 

However,  the  transition  rates  between  states  in  Figure  6  and  S  do  not  agree.  This  can  cause  the  results  to  no 
longer  be  exact  We  can  attempt  to  overcome  this  problem  by  having  the  same  transitions  between  the  sutes  of  the 
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nonbloddng  netwoifc  u  shown  in  Figure  7. 


Figure  7. 

Figure  7  and  Figure  5  have  exacdy  the  same  structure  and  the  same  transition  rates.  On  the  other  hand,  since 
we  have  a  network  with  load-dependent  service  rates,  transition  rates  of  Figure  6  are  more  realistic  than  those  of 
Figure  7.  We  will  investigate  further  on  which  diagram  should  be  analyzed,  and  explore  the  possibility  of  extending 
our  exact  algorithm  [AKYLSSa]  to  handle  the  "load-dependent”  case. 


4,  Extended  Parametric  Analysis  of  Blocking  Queueing  Networks  (PROPOSED  CONCEPT  II) 

Some  papers  extending  Norton’s  Theorem  for  queueing  networks  with  infinite  capacity  have  been  published 
in  the  recent  years.  Kritzinger/van  Wijk/Krzesinski  [KRrT82]  have  extended  the  work  of  [CHANTS]  to  closed, 
open  and  mixed  queueing  networks  with  multiple  job  classes.  Balsamo/IazeoUa  [BALS82]  partition  a  network 
with  N  stations  and  K  jobs  into  two  subsystems  where  the  first  subsystem  contains  the  stations  whose  behavior  is 
to  be  studied  and  the  second  subsystem  represents  the  uninteresting  part,  i.e.,  stations  whose  behavior  is  not  of 
interest  Their  method  is  based  on  the  matrix  of  the  transition  probabilities.  They  eliminate  one  uninteresting  station 
by  setting  its  mean  service  time  equal  to  zero,  and  obtain  a  new  transition  probability  matrix  for  the  jobs.  They 
repeat  this  elimination  procedure  for  the  next  uninteresting  station  and  construct  a  new  transition  probability 
matrix  for  the  jobs.  This  elimination  procedure  must  be  repeated  and  a  new  transition  probability  matrix  must  be 
constructed  for  each  station  as  diey  want  to  eliminate.  This  method  is  complex  and  requires  a  large  amount  of  com¬ 
putation  time  for  large  queueing  networks. 

We  will  extend  the  parametric  analysis  of  blocking  queueing  networics  as  proposed  in  section  3,  in  which  a 
queueing  network  model  can  arbitrarily  be  partitioned  into  S  disjoint  subnetworks,  in  short  form  SNWj  (for 
j  a  each  containing  multiple  stations.  This  concept  is  illustrated  by  the  example  given  in  Figure  1.  Figure 

8  shows  the  given  queueing  netwotk  from  Figure  1  decompose(}into  4  subnetworks. 
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Each  subnetwoffc  SNWj  is  analyzed  by  shorting  all  other  sudons  in  all  other  subnetworks,  i.e.,  their  service 
times  are  set  to  zero.  Since  the  subnetworks  can  be  analyzed  independently,  this  analysis  can  be  executed  in 
parallel.  As  a  result,  the  load  dependent  throughput  values  Mk)  for  each  subnetwoik  are  obtained  simultane¬ 
ously.  Each  subnetwoik  SSWj  containing  multiple  stations  can  thus  be  composed  into  a  single  station.  The  com¬ 
puted  load  dependent  throughputs  M.k )  for  each  SNWj  (for  1  <  y  <  5)  are  set  equal  to  the  load  dependent  service 
rates  of  the  respective  composite  station.  The  composite  stations  are  serially  switched  and  the  simplified 
network,  shown  in  Figure  10,  is  easily  analyzed  when  computing  all  relevant  characteristic  performance  measures. 
These  measures  are  valid  for  each  sution  of  the  originally  given  network  model.  Figure  1. 
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Figure  9. 

This  extended  panmetric  analysis  is  not  only  motivated  only  by  the  desire  to  accelarate  the  processing  speed 
and  reduce  the  memory  space,  but  also  by  the  fact  that  some  stations  (more  than  one)  could  be  studied  under  various 
system  input  parameters  in  which  the  remaining  subsystem  is  represented  by  a  composite  station  containing  ail  sta¬ 
tions  whose  behavior  does  not  interest  us. 


As  a  formal  example,  assume  that  stations  1  and  2  in  Figure  1  represent  two  independent  (ZPU's.  If  we  wish 
to  investigate  only  these  CPU’s  under  various  workload  parameters,  we  do  not  need  to  consider  the  remaining  sta- 
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tions  (3  through  12)  in  our  computations.  It  is  sufficient  to  initially  analyze  the  remaining  system  computing  the 
composite  load  dqpendent  throughput  values  X(jk)  by  setting  the  mea.  'ervice  times  of  both  CPU’s  (stations  1 
and  2)  to  zero,  hi  this  way  we  obtain  Figure  10.  in  which  the  composite  station  represents  sutions  3  through  12. 


Figure  10. 

The  mean  service  times  of  the  CPU’s  (sutions  1  and  2)  are  stated  initially  ,  while  the  mean  service  rate  of 
the  composite  station  is  equal  to  the  computed  load  dependent  throughput  value  X(k).  This  queueing  network 
model.  Figure  10,  can  be  used  for  the  analysis  of  the  sutions  1  and  2  under  various  system  input  parameters. 

The  extended  parametric  analysis  is  realized  in  three  steps; 

4.1.  Computation  of  the  load  dependent  throughputs 

4.2.  Composing  of  Subnetworks 

4.3.  Analysis  of  Serial  Order 

4.1.  Computation  of  the  load  dependent  throughputs  for  the  subnetworks 

In  order  to  analyze  a  subnetwork  SNWj,  we  must  short  all  sutions  which  do  not  belong  to  that  subnetwork 
SNWj.  We  then  compute  the  load  dependent  throughputs  for  each  subnetwoilt  SNWj  for  ( 1  <  y  <  5).  For  the 
compuution  of  this  measure  we  will  use  the  algorithm  proposed  in  section  3.1.  Note  that  each  subnetwoilc  can  be 
analyzed  independently  from  the  othen.  The  independent  analysis  of  each  subnetwork  can  be  executed  in 
parallel  in  order  to  aocelarate  the  processing  speed.  In  the  infinite  cq>acity  network  case  we  realized  this  parallel 
execution  on  4  processon  and  reached  an  acceleration  of  the  computations  by  a  factor  of  3  to  3.5  [AKYL86b].  An 
optimal  decomposition  aggregates  the  entire  network  into  multiple  subnetworks  such  that  the  following  relation  is 
valid: 

{Number  of  Subnetworks}  mod  n  i  (n  -  1)  (6) 

where  n  is  the  number  of  processon. 
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The  puipose  of  this  relation  is  to  prevent  processors  from  waiting  on  the  results  of  other  processors. 

4^  Composing  of  Sabnetworks 

We  compose  the  stations  of  each  subnetwork  into  one  station.  The  mean  service  rate  Pe(k}ofthis  compo¬ 
site  statkm  is  dq>endent  on  the  number  of  jobs  in  the  subnetwotk  and  is  given  by  the  throughput  of  the  compo¬ 
site  subnetwork. 

\sNW,(^)  fory  =  (7) 

These  conqxKite  sudons  are  switched  serially  in  an  arbitrary  order. 

The  same  problem  occurs  here  arises  with  the  capacity  of  each  composite  station.  The  solution  of  section  (3.2) 
will  provide  an  answer  to  this  probletiL 

4J.  Analysis  of  Serial  Order 

For  the  analysis  of  these  arbitrarily  ordered  serially  switched  composite  stations  we  apply  the  algorithm  sug¬ 
gested  in  [AKYLSSc].  Note  that  the  algorithm  suggested  in  [AKYLSSc]  is  applicable  to  Type  la  stations.  However, 
it  can  easily  be  extended  such  that  other  types  of  stations  can  also  be  analyzed. 

REMARK 

The  Extended  Parametric  Analysis  concept  can  be  applied  in  order  to  simplify  the  computational  require¬ 
ments  involved  in  large  queueing  network  models  with  blocking.  Using  this  concept,  the  large  storage  requirement 
and  the  long  run  times  of  the  existing  algorithms,  in  particular  of  our  algorithm  [AKYLSSc]  can  be  reduced  drasti¬ 
cally.  This  is  due  to  the  fact  that  the  one  large  queueing  network  is  analyzed  as  multiple  small  independent  net¬ 
works. 

The  major  advantage  of  this  technique  is  that  computational  expenses  are  reduced  if  only  a  few  stations  from 
the  queueing  network  model  are  to  be  investigated  under  various  system  woikloads.  In  this  case  we  must  determine 
the  throughput  values  of  the  subnetwork  which  contains  the  interesting  stations.  These  throughput  results  are  then 
used  for  the  analysis  of  the  remaining  subnetworks.  The  advantage  results  from  the  fact  that  the  throughput  values 
for  the  remaining  subnetworks  are  computed  only  once  in  the  beginning  and  remain  6xed  under  various  system 


workloads. 
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5.  Validation 

Our  solutions  in  both  cases  (Parametric  and  Extentkd  Parametric  Analysis)  will  be  approximate.  For  valida¬ 
tion  all  suggested  formulas  and  the  proposed  algorithms  must  be  tested  and  implemented.  A  large  variety  numerical 

examples,  including  several  stress  tests,  must  be  executed  and  then  compared  with  simulation  results.  The  RESQ 

[SAUE81]  simulation  package  is  used  to  simulate  the  blocking  networks. 
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